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Assessment  Highlights 

Grade  9 English  Language  Arts 


This  report  provides  teachers,  school  administrators,  and  the  public  with  an  overview  of  the  results 
for  the  June  1994  Grade  English  9 Language  Arts  provincial  assessment.  It  complements  the 
detailed  school  and  jurisdiction  reports. 


Percentage  of  Students  Meeting:  Who  Wrote  the  Test? 


Acceptable  Standard 

100  


Writing  Reading  Total  Test 


Standard  of  Excellence 


m Achievement  Standards* 
□ Actual  Results** 


Students  registered  in  the  Grade  9 English  Language  Arts 
program  were  expected  to  write  the  1994  achievement  test. 
A total  of  33  257  students  completed  the  June  1994 
assessment.  This  number  reflects  an  increase  of 
approximately  5 000  students  over  last  year’s 
administration  of  the  Grade  9 Science  Achievement  Test. 

What  Was  the  Test  Like? 

The  test  had  two  parts. 

Part  A:  Writing  provided  students  with  printed  song  lyrics, 
accompanied  by  an  audio  taped  version  of  the  song,  as  a 
prompt  for  their  writing.  Students  chose  the  format 
(narrative,  letter,  or  diary/journal  entries)  that  would  allow 
them  to  do  their  best  writing.  This  part  of  the  test  was 
scored  in  five  categories:  Content,  Organization,  Sentence 
Structure,  Vocabulary,  and  Conventions.  Content  and 
Organization  were  weighted  to  be  worth  twice  as  much  as 
each  of  the  other  categories. 

Part  B:  Reading  consisted  of  65  multiple-choice  questions 
based  on  reading  selections  that  were  either  informational 
or  narrative/poetic  in  nature. 

How  Well  Did  Students  Do? 

Not  quite  as  many  students  as  expected  met  provincial 
standards.  However,  given  the  greater  number  of  students 
who  took  the  test  this  year  and  the  slight  increase  in  the 
writing  standards,  student  performance  is  encouraging. 

Has  Achievement  Changed  Since  1986? 


. . r . . A special  study  of  changes  in  achievement  was  conducted  as 

*the  percentage  of  students  in  the  province 

expected  to  meet  the  acceptable  standard  provincial  assessment.  Results  showed  that 

and  the  standard  of  excellence  achievement  in  reading  in  1994  was  not  significantly 

**the  percentage  of  students  in  the  different  from  results  in  either  1986  or  1990.  However,  in 

province  who  met  standards  writing,  preliminary  results  showed  an  improvement  over 

results  from  both  1986  and  1990. 


University  ueR^Rr 
university  OE  ALBERIA 


Part  A:  Writing 

Test  Blueprint 

The  blueprint  for  Part  A:  Writing  shows  the  reporting  categories  (scoring  guide),  a description  of  the 
writing  assignment,  and  the  standards. 


Reporting  Category 

Description  of  Writing  Assignment 

Standards 

*Content  (Selecting  Ideas  and  Details  to  Achieve  a 

The  writing  assignment  is  a 

The  student’s  achievement  in 

Purpose) 

response  to  song  lyrics  that  are 

each  reporting  category  will  be 

The  student  should  be  able  to  respond  to  a selection  of 

accompanied  by  an  audio  tape 

described  according  to  the 

literature  and  communicate  that  response  appropriately 

version.  The  student  may  use  ideas 

following  standard  statements: 

to  a specified  audience. 

from  previous  experience  and/or 
reading.  The  assignment  allows  the 

— meets  the  standard  of 

*Organization  (Organizing  Ideas  and  Details  into  a 

student  to  select  the  format  that 

excellence 

Coherent  Whole) 

The  student  should  be  able  to  organize  the  response 

would  allow  for  his/her  best  writing. 

— approaches  the  standard  of 

effectively  and  coherently  to  produce  a unified 
composition  that  achieves  the  student’s  purpose  for 

excellence 

writing. 

— clearly  meets  the  acceptable 
standard 

Sentence  Structure  (Structuring  Sentences 
Effectively) 

— does  not  meet  the  acceptable 

The  student  should  be  able  to  use  a variety  of  sentence 
types  and  structures  to  achieve  clarity,  interest,  and 

standard 

emphasis. 

— clearly  below  the  acceptable 
standard 

Vocabulary  (Selecting  and  Using  Words  and 
Expressions  Correctly  and  Effectively) 

The  student  should  be  able  to  use  words  and  expressions 
appropriately  and  effectively  to  communicate  to  the 
specified  audience  and  to  achieve  the  student’s  purpose. 

INS — insufficient 

Conventions  (Using  the  Conventions  of  Written 
Language  Correctly  and  Effectively) 

The  student  should  be  able  to  communicate  clearly  by 
adhering  to  appropriate  spelling,  punctuation,  and 
grammar  conventions. 

*These  categories  are  weighted  to  be  worth  twice  as  much  as  each  of  the  others. 


Observations  and  Results 

The  overall  quality  of  the  writing  in  English  Language  Arts  in  1994  is  better  than  that  done  in  1990. 
Teachers  who  marked  the  tests  were  very  pleased  with  most  of  the  papers.  They  observed 
specifically  that  students  are  strong  in  the  following  areas:  content,  organization,  and  especially 
vocabulary.  The  markers  agreed  that  students,  for  the  most  part,  showed  genuine  confidence  in 
their  writing  and  hence  were  willing  to  take  the  risks  that  resulted  in  a better  product. 

A small  number  of  students  wrote  papers  that  were  technically  superior.  These  papers  showed  the 
students’  real  depth  of  understanding  of  the  subject  matter,  as  well  as  an  ability  to  draw  on 
knowledge  of  global  issues  that  related  to  the  prompt.  The  quality  of  these  papers  far  exceeded  the 
expectations  for  students  in  a Grade  9 classroom. 

The  Student  Evaluation  Branch  is  preparing  a Samples  of  Students'  Writing  booklet  that  contains 
demonstrations  of  the  full  range  of  student  writing  in  1994,  accompanied  by  commentaries  on  the 
relative  strengths  and  weaknesses  of  the  writing,  as  well  as  the  standards  used  in  marking.  Copies 
of  this  document  will  be  sent  to  each  school  that  has  students  enrolled  in  Grade  9. 
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Percentage  Distribution  of  Scores  by  Reporting  Category  for  Written  Response 


Standards 

Reporting  Category 

Content 

Organization 

Sentence 

Structure 

Vocabulary 

Conventions 

Meets  the  Standard  of  Excellence 

8.0 

7.7 

6.9 

6.9 

8.0 

Approaches  the  Standard  of  Excellence 

27.0 

25.2 

24.4 

22.1 

26.7 

Clearly  Meets  the  Acceptable  Standard 

47.9 

47.0 

49.6 

60.4 

42.9 

Does  Not  Meet  the  Acceptable  Standard 

15.2 

17.8 

16.5 

9.4 

19.3 

Clearly  Below  the  Acceptable  Standard 

1.5 

2.0 

2.3 

1.0 

2.8 

INS  (Insufficient) 

0.3 

0.3 

0.3 

0.3 

0.3 

Part  B:  Reading 

Test  Blueprint 

The  blueprint  for  Part  B:  Reading  shows  the  reporting  categories  and  language  function  under  which 
questions  are  classified. 


Question  Distribution  by 
Language  Function 

Reporting  Category 

Informational 

(efferent) 

Narrative/Poetic 

(aesthetic) 

Number  of 
Questions 

Percent 
of  Test 

1.  Attending  to  Details 

The  student  should  be  able  to  construct  meaning  from  prior 
experience  emd  by  attending  to  and  interpreting  details 
related  to  format  cues  and  character  (actions,  motives,  and 
values),  setting,  action  and  events,  conflict,  and  mood  in  a 
reading  selection. 

12,  29,  30,  33 

2,  3,  6,  14,  18,  25, 
40,  50,51,58,60, 
64 

16 

25 

2.  Identifying  the  Organization  of  Ideas 

The  student  should  be  able  to  identify  and  understand  the 
relationship  of  the  author’s  intention  and  point  of  view  in  a 
reading  selection  to  the  choice  of  form  and  writing  style  and 
to  organizational  methods  such  as  chronological  order, 
cause/effect,  foreshadowing,  flashback,  and 
comparison/contrast. 

32,  54,  55,  56 

5,  22,  35,  41,  52,  59 

10 

15 

3.  Associating  Meaning 

The  student  should  be  able  to  associate  meanings  of  words 
and  expressions  from  prior  knowledge  and  contextual  clues, 
and  determine  the  meaning  and  effect  of  the  more  common 
types  of  figurative  language  in  a reading  selection. 

13,  26,  27 

1,  15,  16,  17,  36,  37, 
38,  46,  47,  49,  62, 

63 

15 

23 

4.  Synthesizing  Ideas 

The  student  should  be  able  to  S3mthesize  ideas  from  the 
entire  reading  selection  in  order  to  deduce  the  main  idea, 
to  construct  meaning,  and  to  predict  plausible  outcomes  or 
conclusions. 

9,  10,  11,  28, 
31,  34,  44,  45, 
57 

4,  7,  8,  19,  20,  21, 
23,  24,  39,  42,  43, 
48,  53,  61,  65 

24 

37 

Total  Number  of  Items 

20 

45 

65 

100 

Total  Percent 

31 

69 

100 

100 
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Test  Results 

Individual  Multiple-Choice  Questions 


Question 

Key 

Difficulty* * 

Question 

Key 

Difficulty 

Question 

Key 

Difficulty 

1 

B 

73.0 

23 

B 

45.9 

45 

A 

57.5 

2 

A 

88.6 

24 

D 

46.0 

46 

D 

80.4 

3 

C 

67.9 

25 

C 

33.4 

47 

C 

56.3 

4 

B 

76.6 

26 

A 

74.9 

48 

B 

71.9 

5 

D 

75.6 

27 

D 

27.9 

49 

D 

65.9 

6 

B 

84.3 

28 

B 

44.1 

50 

A 

69.8 

7 

C 

75.3 

29 

C 

57.8 

51 

B 

61.5 

8 

A 

66.1 

30 

A 

65.5 

52 

A 

64.9 

9 

C 

71.9 

31 

D 

50.2 

53 

C 

77.4 

10 

C 

47.4 

32 

B 

80.5 

54 

D 

71.9 

11 

D 

60.4 

33 

C 

64.6 

55 

C 

79.3 

12 

B 

78.6 

34 

B 

81.1 

56 

B 

71.0 

13 

C 

57.9 

35 

D 

40.0 

57 

D 

54.9 

14 

C 

41.7 

36 

B 

26.3 

58 

C 

79.1 

15 

D 

25.1 

37 

D 

53.4 

59 

A 

71.1 

16 

D 

74.7 

38 

A 

82.0 

60 

D 

72.8 

17 

D 

49.5 

39 

B 

48.6 

61 

A 

72.9 

18 

C 

80.7 

40 

B 

46.6 

62 

B 

57.1 

19 

A 

55.2 

41 

C 

64.9 

63 

D 

66.4 

20 

B 

47.9 

42 

C 

71.1 

64 

A 

84.0 

21 

B 

40.6 

43 

A 

68.6 

65 

C 

66.5 

22 

A 

36.4 

44 

B 

69.8 

*Difficulty — percentage  of  students  answering  the  question  correctly 


Observations  and  Sample  Questions 

The  following  is  a discussion  of  specific  areas  of  strength  and  weakness  for  students  in  Grade  9 
classrooms.  Sample  questions  from  the  test  are  provided  to  highlight  these  areas  for  students 
meeting  the  acceptable  standard  and  for  those  meeting  the  standard  of  excellence.  For  each  sample 
question,  the  keyed  answer  is  marked  with  an  asterisk.  The  percentage  of  students  choosing  each 
alternative  is  also  provided. 


6.  Throughout  most  of  the  story,  the 
narrator  is 

1 0.4  A.  confident 
84.3  *B.  indecisive 
2.4  C.  relaxed 
2.8  D.  forceful 


57.  In  the  Dewey  Decimal  System,  works 
of  fiction  would  be  found  under 


Acceptable  Standard 

For  question  6,  students  had  to  locate  key  character  details  in 
the  passage.  Students  who  met  the  acceptable  standard  were 
able  to  do  this. 

In  question  57,  many  students  meeting  the  acceptable 

standard  had  difficulty  drawing  conclusions  by  S5mthesizing 
pertinent  details  from  a reading  selection.  Only  55%  of  all 
students  were  able  to  do  this. 


25.5 

A. 

General  Works 

6.5 

B. 

Languages  and  Dictionaries 

13.0 

C. 

Arts 

54.9 

*D. 

Literature 

The  strengths  of  students  who  met  the  acceptable  standard 
include  an  ability  to 

• understand  the  relationship  among  details  in  a reading 
selection 

• identify  directly  stated  details  of  setting  and  character 

• infer  character  motivation 
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However,  many  of  these  students  did  not  do  as  well  as  expec 

• inferring  the  meaning  of  words  and  phrases  from  the  contc 
the  materials 

• making  judgements  about  character  motivation  by  synthej 
information  in  a reading  selection 

• drawing  conclusions  by  S3mthesizing  pertinent  details  fron 
reading  selection  (see  question  57) 

• judging  the  author’s  purpose  for  writing 


8.  The  author’s  purpose  is  to 

66.1  *A.  entertain 
7.5  B.  inform 
21.4  C.  persuade 
4.9  D.  instruct 


49.  The  “poor  weak  dot  of  light”  (line  25) 
refers  to 


4.4 

A. 

Ra 

14.1 

B. 

a star 

15.5 

C. 

their  home 

65.9 

*D. 

Earth 

Standard  of  Excellence 

Students  meeting  the  standard  of  excellence  had  no  difficulty 
the  following  sample  questions,  which  tended  to  be  difficult : 
those  students  meeting  the  acceptable  standard. 

Question  8 requires  students  to  make  a judgement  about  tl 
author’s  purpose  for  writing  the  selection.  Most  of  those  stu 
meeting  the  standard  of  excellence  answered  this  question 
correctly. 

Question  49  required  students  to  recognize  word  connotati( 
beyond  their  literal  meaning.  Of  those  students  meeting  the 
standard  of  excellence,  about  95%  answered  this  question 
correctly. 


Students  who  met  the  standard  of  excellence  had  very  few 

difficulties  with  this  assessment.  These  students  could 

• synthesize  information  from  a selection  to  make  inferencei 
judgements,  and  draw  conclusions 

• recognize  the  meanings  of  words  and  phrases  from  the  con 
of  the  material 

• make  judgements  about  the  author’s  purpose  for  writing  ({ 
question  8) 

• understand  the  author’s  point  of  view 

• understand  the  selections  that  were  not  in  narrative  form: 
poems,  cartoons,  and  charts 


Issues 

During  the  1994  marking  session,  teachers  were  asked  to  comment  on  both  parts  of  the  test. 

Some  areas  of  concern  emerged  from  the  writing  component.  Many  teachers  believe  that  diary/journal 
writing  should  not  be  given  as  one  of  the  format  choices  because  students 

might  not  carefully  attend  to  conventions  or  select  a suitable  vocabulary.  Other  teachers  said  that 
diary/journals  are  a “comfortable”  format  for  many  students,  which  should,  in  fact,  allow  them  to  do 
their  best  writing.  Actually,  most  students  who  selected  this  format  did  write  a narrative  with 
appropriate  vocabulary  and  conventions.  Many  teachers  believe  that  students  should  be  given  the 
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opportunity  to  talk  about  the  topic  before  beginning  their  writing.  This  was  tried  successfully  with 
Grade  3 students  in  1993,  and  plans  are  underway  to  include  this  as  an  option  for  Grade  9 students 
in  June  1995. 

One  area  of  concern  that  emerged  from  the  multiple-choice  reading  component  was  the  issue  of  genre 
used  in  the  assessment.  Many  feel  that  poetry  should  have  a less  prominent  role,  especially  lyric 
poetry  that  tends  to  be  more  difficult  for  students.  In  the  future,  closer  attention  will  be  paid  to  the 
type  of  poetry  included  and  efforts  will  be  made  to  use  more  narrative  poetry. 


Performance-Based  Assessment 

As  part  of  Alberta  Education’s  Broadened  Assessment  initiatives,  a sample  of  569  Grade  9 students 
from  across  the  province  participated  in  the  Listening  and  Viewing  Skills  performance-based 
assessment.  This  activity-based  assessment,  using  audio  and  video  tapes,  was  developed  by  Grade  9 
teachers  to  assess  listening  and  viewing  skills  to  complement  the  Grade  9 English  Language  Arts 
Achievement  Test  and  to  support  classroom  instruction. 

Students  remained  together  as  a class  in  their  regular  classroom  setting  with  the  assessment 
administrator  and  the  classroom  teacher  present  whenever  possible.  For  the  first  part  of  the 
assessment,  students  listened  to  an  audio  tape  of  different  selections  and  responded  to  a series  of 
open-ended  questions  based  on  what  they  heard.  Then  they  viewed  a video  tape  with  some  sound 
effects  but  no  dialogue  and  responded  to  more  open-ended  questions  that  required  interpretation  of 
what  they  had  seen  on  the  video. 

Students  were  given  two  hours  to  complete  the  assessment.  By  engaging  students  in  listening  and 
viewing  activities  and  asking  them  to  respond,  we  obtained  valuable  information  about  how  well 
students  listen  and  whether  or  not  they  can  view  material  critically. 


Acceptable  Standard 

Standard  of  Excellence 

Reporting  Category 

Percent  of  Students  Achieving 

Percent  of  Students  Achieving 

Standard 

Standard 

Listening 

89.5 

13.9 

Viewing 

70.3 

3.7 

The  assessment  was  divided  into  nine  scoring  categories  (Following  Directions,  Classifying, 
Synthesizing/Writing,  Retelling,  Symbolism,  Conflict,  Personal  Connections,  Opinion,  and 
Explanation)  and  the  way  in  which  students  met  the  scoring  criteria  varied  depending  on  the 
category.  Most  students  were  able  to  follow  directions,  synthesize  material  and  then  write  a 
newspaper  story.  As  well,  they  could  readily  express  their  own  opinions,  however,  they  had  difficulty 
supporting  them.  Retelling  and  connecting  what  they  saw  to  their  personal  experiences  proved 
difficult  for  most  students. 

As  the  results  show,  students  have  better  listening  than  viewing  skills.  By  the  time  students  have 
reached  Grade  9,  they  are  very  used  to  listening  to  a variety  of  sources  to  access  information.  Even 
though  these  same  students  spend  a great  deal  of  time  watching  television,  videos,  etc.,  they  are  used 
to  being  very  passive  viewers  who  are  entertained  by  what  they  see.  They  do  not  view  most  material 
in  a critical  way  and  need  guidance  and  practice  in  doing  so. 

One  of  the  most  positive  outcomes  of  the  administration  of  the  performance-based  components  was 
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the  way  it  was  received  by  both  teachers  and  students.  Students  found  this  a novel  form  of 
assessment  and  teachers  were  happy  to  have  a straightforward  model  that  they  could  follow  as  a 
means  of  assessing  their  students’  listening  and  viewing  skills. 


Questionnaire — Context  for  Learning 

In  1994,  a random  selection  of  Grade  9 teachers  and  students  from  all  parts  of  the  province  answered 
a questionnaire  designed  to  identify  and  examine  the  relationship  among  various  contexts  for 
learning  and  their  effect  on  achievement.  Students  gave  their  opinions  on  various  Language  Arts 
issues.  Preliminary  information  gleaned  from  the  student  questionnaires  is  very  interesting. 

There  were  significant  differences  in  the  way  in  which  students  perceive  reading  and  writing.  They 
generally  think  of  themselves  as  better  readers  than  writers;  they  enjoy  reading  more  than  writing; 
they  see  reading  as  more  important  for  their  future;  and  they  spend  much  more  of  their  leisure  time 
(outside  school)  reading  than  writing.  Students  think  that  they  are  better  readers  than  they  believe 
others  (peers,  teachers,  parents)  perceive  them  to  be.  Most  students  are  enthusiastic  about  learning 
new  things. 

On  the  teacher  questionnaires,  teachers  reported  that 

• they  are  using  a variety  of  instructional  groupings  in  their  language  arts  classes  (whole  class, 
small  groups,  individual)  with  less  time  being  spent  where  students  work  in  small  groups 

• their  students  primarily  read  literature  and  that  functional  print  materials  are  sometimes  used 

• their  students  use  journals  and  learning  logs  on  a limited  basis 

• they  communicate  learner  expectations  and  show  their  students  model  responses  before  instruction 
and  assessment 

• they  give  their  students  continual  feedback  about  their  progress 

• they  use  assessment  results  for  a variety  of  purposes  but  primarily  as  part  of  their  summative 
reporting 

• their  students  have  a minimal  role  in  their  own  assessment 

• their  students  generally  have  a positive  attitude  toward  Language  Arts 

Questionnaires  will  continue  to  be  administered  in  future  assessments. 


For  further  information,  contact  Jo-Anne  Hug,  Assessment  Specialist,  at  403-427-0010. 


Printed  October  1994 
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